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Abstract 

We count permutations avoiding a nonconsecutive instance of a two- or three- 
letter pattern, that is, the pattern may occur but only as consecutive entries in 
the permutation. Two-letter patterns give rise to the Fibonacci numbers. The 
counting sequences for the two representative three-letter patterns, 321 and 132, 
have respective generating functions (1 -|- x'^){C{x) — 1)/(1 + x + x'^ — xC{x)) and 
C{x + x^) where C{x) is the generating function for the Catalan numbers. 

1. Introduction There is a large literature on pattern avoidance in 
permutations and words. Problems treated include counting permutations avoiding a 
pattern or set of patterns, or containing patterns a specified number of times. Or a 
pattern may be allowed but only as part of a larger pattern. Pattern occurrences may 
be unrestricted (the classical case), or required to be consecutive (i.e., contiguous entries 
in the permutation), or a mixture of the two. Here we consider the following variation. 
Given a pattern vr, how many permutations on [n] avoid nonconsecutive instances of vr, 
that is, the pattern tt may occur but only as consecutive entries in the permutation. In 
other words, all occurrences of tt are required to be of the consecutive type. As usual, for 
TT = (tti, 7r2, . . . , TTfc) a permutation on [k], an instance of vr in a permutation (ai, a2, ■ ■ ■ , an) 
is a subpermutation (a^j, Ojj, • • • , Oij.), I < ii < . . . < ik < n, whose reduced form (replace 
smallest entry by 1, next smallest by 2, and so on) is tt. In the present paper we deal 
with patterns of length < 3. The operations reverse and complement {a^ n + 1 — a^) 
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on permutations and patterns preserve this type of pattern avoidance; so we need only 
consider representative patterns in the orbits under the action of the group they generate. 
For patterns of length < 3, this reduces the problem (as usual) to the patterns 21, 321 
and 132. The following sections treat them one at a time. 

2. The 21 pattern Avoiding a nonconsecutive 21 means that every 
inversion arises from a contiguous pair of entries. Such permutations on [n] are all obtained 
from the identity permutation (1, 2, . . . , n) by selecting a set of non-overlapping pairs of 
consecutive integers in [n] and, for each pair, switching the entries in those 2 positions. 
The first entries of these pairs form a scattered subset of [n — 1], that is, a subset for which 
distinct elements differ by at least 2. It is well known that such subsets are counted by 
the Fibonacci number Hence we have 

Theorem 1. The number of permutations on [n] that avoid a nonconsecutive 21 pattern 

IS Fn+l. 



3. The 321 pattern Let us introduce some notation: 

• An is the full set of permutations on [n] that avoid a nonconsecutive 321. 

• Bni'Dn are, respectively, the permutations in An that start with a 321 in the first 3 
positions, and those that don't. Thus \An\ = \Bn\ + |2^n|- 

• Cn is the set of permutations in An that contain no 321 at all, the set of so-called 
321-avoiding permutations. It is well known [1] that |C„| = C„, the nth Catalan 
number. 

• An,ki (1 < < n — 2) is the set of permutations in An that contain one or more 
(necessarily consecutive) 321s, the first of which starts at position k. Thus \An\ = 

Cn ~\~ ^2ik=l \'^ri,k\- 

First, observe that a permutation in i3„ (n > 3) must have 2 as its second entry and 1 as 
its third entry (else an offending pattern would be present). Deleting these entries and 
subtracting 2 from all other entries is a bijection to X'„_2. Hence \Bn\ = \T^n-2\- Next, 
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given p G An,k (2 < A; < n — 2), we can form two new permutations cr, r as follows. Take 
the first A; — 1 entries and the entry in position k + 2 (necessarily comprising the first k 
positive integers) to form cr. Delete the first k — 1 entries and reduce (replace smallest 
entry by 1, next smallest by 2, and so on) to form r. We leave the reader to verify that 
this is a bijection An,k ^ x S„-fc+i- Hence \An,k\ = Ck\Bn-k+i\ = Ck\Vn^k-i\- 



Now, with a lowercase letter a„ denoting the size of An and so on, we have just shown 
that ttn = Cn + J2k=i'^kdn-k-i (siuce Ci = 1). But also Un = bn + dn and fo„ = dn-2- 
Eliminating a„ and bn and reindexing yields 

n—3 

dn = Cn + Ck+ldn-2-k, 
k=l 

a recurrence for dn that is valid for n > 1 and hence determines dn (no initial condition 
necessary). Since the sum is a convolution, this recurrence routinely yields the generating 
function 

D x) ^ ' 



1 + — xC*{x) ' 



where D{x) := Y.n>i^nX"' and C*{x) := Y.n>i^riX"' = ^ - 1 (the superscript * 

indicating that Cq is omitted from the sum). The formula for a„ then yields 

Theorem 2. The number an of permutations on [n] that avoid a nonconsecutive 321 
pattern has generating function 

C*{x) 



^anx"" 



n>l ^ ^ 



The sequence (a„)n>i begins 1, 2, 6, 18, 56, 182, 607, 2064, .... 



3. The 132 pctttem First, observe that 132-avoiding permutations are 
characterized by the property that, for each entry a, the set of succeeding entries that 
are < a form an initial segment of the positive integers. Also, Simion and Schmidt [2] 
gave a bijection (see [3] for an equivalent description) from 132-avoiding to 123-avoiding 
permutations, the latter corresponding to 321-avoiding under reversal, and so 132-avoiding 
permutations are also counted by the Catalan numbers. 

Now let £n denote the set of permutations on [n] that avoid a nonconsecutive 132 and 
£n,k the permutations in 8^ with k (necessarily consecutive) 132s. Consider a permutation 
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in Sn,k- First, record the positions ii, Z2, . . . , "ifc of the middle entries of its 132 patterns — 
they form a subset of the interval [2, n — 1] whose entries all differ by at least 3 because, 
as is easily checked, the 132 patterns cannot overlap. Then delete the first and last entry 
of each 132 pattern and reduce. The result is a 132-avoiding permutation on [n — 2k]. 
Thus each permutation in Sn,k yields a set {ii, ^2, . . . , 4} C [2,n — 1] with entries differing 
by at least 3 together with a 132-avoiding permutation on [n — 2k]. 

Conversely, given any such set and permutation, we can construct a permutation 
in Sn^k that yields them. Take, for example, n = 10 and k = 2 and suppose given 
{ii, Z2, . . . , 4} = {4,8} and 132-avoiding permutation (6,5,3,4,2,1). Place blanks in 
the positions immediately neighboring each ij and place the permutation entries in the 
remaining positions: 

123456789 10 
6 5 3 4 2 1 

Leave intact the entries after the entry in position ii and smaller than it (as noted above, 
these entries form an initial segment 1,2, ... ,j of the positive integers), place j ' + 1 in 
position ii — 1, J + 2 in position ii -|- 1, and increase all other entries by 2: 

123456789 10 
8 7 3 5 4 6 2 1 

Proceed likewise left to right to fill in the remaining pairs of blanks. It is easy to check 
that the result, here (10, 9, 5, 7, 6, 8, 2, 4, 3, 1), is a permutation in £n,k that yields the given 
{ii, 12, ... , ik} and 132-avoiding permutation under the process of the previous paragraph. 

There are ("^^'^) such sets {ii, ^2, • • • , 4} and Cn-2k 132-avoiding permutations on 
[n — 2k] and so \Sn,k\ = {"'~k^)Cn-2k- Summing over k and taking into account the 
permutations that avoid 132 altogether, we have 

Theorem 3. The number of permutations on [n] that avoid a nonconsecutive 132 pattern 
is 
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Routine manipulations lead to a succinct generating function: 

n>0 n,k>0 ^ ^ 



fc>0 ^n>3fc 



fc>0 ^ n>fc ^ 
k>0 

C{x + X^), 



-k\3k 



the last equality by Taylor's theorem, where C{x) = ^ is the generating function 

for the Catalan numbers. So we have 

Corollary. The generating function for permutations that avoid a nonconsecutive 132 
pattern is 

1 - Vl - 4x - 
2(x + x^) 

The counting sequence {n > 0) begins 1, 1, 2, 6, 18, 57, 190, 654, 2306, .... 

Added in Proof These results have previously been obtained in a wider context 
by Anders Claesson [4]. 
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